IN THE CLAIMS: 



The following is a complete listing of the claims, and replaces all earlier 
^ listings and all earlier ver sions 




^ / \Claim 1 (original): A method of processing input data defining (i) the 
positions of features in a sequence of images of at least one object which represent features 
on the object, (ii) an estimate of a respective camera projection for each image defining the 
projection of points on tire object into the image, and (iii) 3D feature points comprising 
estimates of the positions in three-dimensions of features on the object represented by the 
features in the images, to generate output data defining further estimates of the camera 
projections, the method comprising^rocessing respective subsets of the images in the 
sequence by: 

calculating an enx>r\for the camera projections of the images in the 
subset by projecting selected 3D feature points into the images in the subset using the 
camera projections of the images in the subset and determining the distance between the 
positions of the projected points and the positions o\the corresponding features in the 
images; and 

calculating changed positions for atMeast some of the selected 3D 
feature points and changed camera projections for the images\in the subset by using the 
positions in the images in the subset of the features which correspond to the selected 3D 
feature points to determine changed positions for at least some of the selected 3D feature 
points and changed camera projections for the images in the subset wi\ich reduce the 
calculated error[[;]] a 
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\ wherein the respective subsets of images are selected sequentially 

from the sequence so that each image in the sequence is processed in a subset at least once. 

Claim ^(original): A method according to claim 1, wherein the changed 
positions for the 3D feature points and the changed camera positions are calculated by 
reducing the calculated erroXby performing processing in accordance with a minimisation 
procedure to change iteratively\he positions of at least some of the selected 3D feature 
points and the camera projections\)f the images in the subset and to calculate an updated 
error by projecting the 3D feature poWs from their changed positions into the images in the 
subset using the changed camera projections of the images in the subset, and determining 
the distance between the positions of the projected points and the positions of the 
corresponding features in the images. \ 

Claim 3 (original): A method according to claim 2, wherein the calculated 
error is reduced by performing processing in accordance with a non-linear least squares 
minimisation procedure. \ 

Claim 4 (original): A method according to claim 3, wherein the calculated 
error is reduced by performing processing in accordance with a Leyenberg-Marquardt 
minimisation procedure. \ 

Claim 5 (original): A method according to claim 1, wherein the changed 
positions for the 3D feature points and the changed camera projections are calculated by 
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decomposing a matrix representing the positions in the images in the subset of the features 
which\prrespond to the 3D feature points to be changed into the product of a first matrix 
representing the changed camera projections of the images in the subset and a second 
matrix representing the changed positions of the 3D feature points. 

Claim ^(original): A method according to claim 1 , wherein the selected 3D 
feature points used to calculate an error comprise every 3D feature point which corresponds 
to a feature having a measured position in at least one of the images in the subset being 
processed. \ 

Claim 7 (original): A method according to claim 1 , wherein the 3D feature 
points for which changed positions are calculated comprise every 3D feature point which 
has a measured position in at least one of the images in the subset being processed but no 
measured position in any of the other images in the sequence. 

Claim 8 (original): A method according to cmim 1, wherein each respective 
subset contains the same number of images. \ 



Claim 9 (original): A method according to claim 1, wherein the number of 
images in a subset is set in dependence upon the number of features in the images having a 
position defined in the data to be processed. \ 



Claim 10 (original): A method according to claim 1, wherein the respective 
subsets of images are selected sequentially from the sequence with an overlap. 

Clairn 1 1 (original): A method according to claim 1, further comprising the 
step of generating a signd conveying the further estimates of the camera projections. 

Claim 12 (original: A method according to claim 1 1 3 further comprising 
the step of recording the signal eithervdirectly or indirectly. 

Claim 13 (original): A method according to claim 1, further comprising the 
step of processing image data defining the image^in the sequence to generate the input 
data. 

Claim 14 (original): A method according tcrclaim 1, further comprising the 
step of using the further estimates of the camera projections to^enerate data defining a 3D 
computer model of the scene in the images. 



Claim 15 (original): A method according to claim 14, fui^her comprising 
the step of generating a signal conveying the 3D computer model. 



Claim 16 (original): A method according to claim 15, further comprising 
the step of recording the signal either directly or indirectly. \ 



\ Claim 17 (currently amended): Apparatus An apparatus for processing input 

data defining (i) the positions of features in a sequence of images of at least one object 
which represent features on the object, (ii) an estimate of a respective camera projection for 
each image definW the projection of points on the object into the image, and (iii) 3D 
feature points compri^ng estimates of the positions in three-dimensions of features on the 
object represented by the ^features in the images, to generate output data defining further 
estimates of the camera projections, comprising a processor for processing respective 
subsets of the images in the sequence by: 

calculating an\rror for the camera projections of the images in the 
subset by projecting selected 3D feature joints into the images in the subset using the 
camera projections of the images in the subset and determining the distance between the 
positions of the projected points and the positions of the corresponding features in the 
images; and \ 

calculating changed positions ror at least some of the selected 3D 
feature points and changed camera projections for the images in the subset by using the 
positions in the images in the subset of the features which correspond to the selected 3D 
feature points to determine changed positions for at least some\of the selected 3D feature 
points and changed camera projections for the images in the subsfet which reduce the 
calculated errorlJ;]]^ \ 

wherein the processor is arranged to process respective subsets of 
images from the sequence sequentially such that each image in the sequence is processed in 
a subset at least once. \ 
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\ Claim 18 (currently amended): Apparatus An apparatus according to claim 

17, whereinthe processor is arranged to calculate the changed positions for the 3D feature 
points and the changed camera positions by reducing the calculated error by performing 
processing in accordance with a minimisation procedure to change iteratively the positions 
of at least some of the selected 3D feature points and the camera projections of the images 
in the subset and to calculatevan updated error by projecting the 3D feature points from their 
changed positions into the images in the subset using the changed camera projections of the 
images in the subset, and determining the distance between the positions of the projected 
points and the positions of the corresponding features in the images. 

Claim 19 (currently amended): Apparatus An apparatus according to claim 

18, wherein the processor is arranged to reduce the^calculated error by performing 
processing in accordance with a non-linear least squares minimisation procedure. 

Claim 20 (currently amended): Apparatus AnVpparatus according to claim 

19, wherein the processor is arranged to reduce the calculated error by performing 
processing in accordance with a Levenberg-Marquardt minimisationsprocedure. 

Claim 21 (currently amended): Apparatus An apparatus according to claim 
17, wherein the processor is arranged to calculate the changed positions for me 3D feature 
points and the changed camera projections by decomposing a matrix representing the 
positions in the images in the subset of the features which correspond to the 3D feature 
points to be changed into the product of a first matrix representing the changed camera 
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projections of the images in the subset and a second matrix representing the changed 
positions^ the 3D feature points. 

Claim 22 (currently amended): A pp aratus An apparatus according to claim 
17, wherein the processor is arranged to perform processing so that the selected 3D feature 
points used to calculate airerror comprise every 3D feature point which corresponds to a 
feature having a measured position in at least one of the images in the subset being 
processed. 

Claim 23 (currently amended): Apparatus An apparatus according to claim 
17, wherein the processor is arranged to perform processing so that the 3D feature points 
for which changed positions are calculated comprise every 3D feature point which has a 
measured position in at least one of the images in the\subset being processed but no 
measured position in any of the other images in the sequence. 

Claim 24 (currently amended): Apparatus An apparatus according to claim 
17, wherein the processor is arranged to perform processing so tha^each respective subset 
contains the same number of images. 



Claim 25 (currently amended): Ap p aratus An apparatus according to claim 
1 7, wherein the processor is arranged to perform processing so that the numbV of images in 
a subset is set in dependence upon the number of features in the images having \position 
defined in the data to be processed. 
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\ Claim 26 (currently amended): Apparatus An apparatus according to claim 

17, wherein the processor is arranged to perform processing so that the respective subsets 
of images ate selected sequentially from the sequence with an overlap. 

Claim\27 (currently amended): Apparatus An apparatus according to claim 
17, further comprising ansinput data generator for processing image data defining the 
images in the sequence to generate the input data. 

Claim 28 (currently amended): A pp aratus An apparatus according to claim 
17, further comprising a 3D computer nWel data generator for using the further estimates 
of the camera projections to generate data defining a 3D computer model of the scene in the 
images. 

Claim 29 (original): A storage device storing instructions for causing a 
programmable processing apparatus to become operable tovperform a method as set out in 
at least one of claims 1 to 16. 



Claim 30 (original): A signal conveying instructions ibr causing a 
programmable processing apparatus to become operable to perform a method as set out in 
at least one of claims 1 to 16. 



Claim 3 1 (currently amended): In an image processing method for 
processing image data defining a sequence of images of at least one object to generate a 
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three-dimensional computer model of the object by matching features in the images, using 
the mkching features to determine camera projections defining the projection of the object 
surface imo the images, and using the matching features and the calculated camera 
projections to generate data defining the three-dimensional computer model of the object, 
an improvem e nt comprising performing the step of using the matching features to 
determine the camera projections by processing data defining (i) the positions of features in 
a sequence of images of thtrobject which represent features on the object, (ii) an estimate of 
a respective camera projection K>r each image defining the projection of the object into the 
image, and (iii) 3D feature points comprising estimates of the positions in three-dimensions 

\ 

of the features on the object represented by the features in the images, to generate data 
defining further estimates of the camera projections, the p r ocessing comprising processing 
respective subsets of the images in the sequence shch that: 

an error is calculated for the car^era projections of the images in the 
subset by projecting selected 3D feature points into the images in the subset using the 
camera projections of the images in the subset to give projected points and determining the 
distance between the positions of the projected points and the positions of the 
corresponding features in the images; and 

changed positions for at least some of the selected ^SD feature points 
and changed camera projections for the images in the subset are calculated bV using the 
positions in the images in the subset of the features which correspond to the selected 3D 
feature points to determine changed positions for at least some of the selected 3D feature 
points and changed camera projections for the images in the subset which reduce the 
calculated errortt;]]^ 
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wherein the respective subsets of images are selected sequentially 
from th^equence so that each image in the sequence is processed in a subset at least once. 

laim 32 (currently amended): In an image processing apparatus for 
processing image data defining a sequence of images of at least one object to generate a 
three-dimensional compU^er model of the object by matching features in the images, using 
the matching features to deteraiine camera projections defining the projection of the object 
surface into the images, and usink the matching features and the calculated camera 
projections to generate data defining the^three-dimensional computer model of the object, a 
method of performing the processing to determine the camera projections by processing 
data defining (i) the positions of features in a^equence of images of at least the object 
which represent features on the object, (ii) an estimate of a respective camera projection for 
each image defining the projection of the object surface into the image, and (iii) 3D feature 
points comprising estimates of the positions in three-dimfensions of the features on the 
object represented by the features in the images, to generate data defining improved 
estimates of the camera projections, the processing comprising processing respective 
subsets of the images in the sequence by: 

calculating an error for the camera projections (Jf the images in the 
subset by projecting selected 3D feature points into the images in the subset using the 
camera projections of the images in the subset to give projected points and determining the 
distance between the positions of the projected points and the positions of the 
corresponding features in the images; and 
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calculating changed positions for at least some of the selected 3D 
feature^ints and changed camera projections for the images in the subset by using the 
positions in ^he images in the subset of the features which correspond to the selected 3D 
feature points to Determine changed positions for at least some of the selected 3D feature 
points and changed can^era projections for the images in the subset which reduce the 
calculated error[[;]] a 

wherein ft^e respective subsets of images are selected sequentially 
from the sequence so that each image in the sequence is processed in a subset at least once. 

Claim 33 (currently amended^: In an image processing apparatus having a 
processor for processing image data defining a sequence of images of at least one object to 
generate a three-dimensional computer model of thk object by matching features in the 
images, using the matching features to determine camefca projections defining the projection 
of the object surface into the images, and using the matching features and the calculated 



camera projections to generate data defining the three-dimensional computer model of the 
object, an improvem e nt wherein the processor is arranged to use The matching features to 
determine the camera projections by processing data defining (i) the\positions of features in 
a sequence of images of the object which represent features on the object, (ii) an estimate of 
a respective camera projection for each image defining the projection of trie object into the 
image, and (iii) 3D feature points comprising estimates of the positions in tn^ee-dimensions 
of the features on the object represented by the features in the images, to generate data 
defining further estimates of the camera projections, the processing performed byVhe 
processor comprising processing respective subsets of the images in the sequence suqh that: 
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an error is calculated for the camera projections of the images in the 
subW by projecting selected 3D feature points into the images in the subset using the 
camera projections of the images in the subset to give projected points and determining the 
distance between the positions of the projected points and the positions of the 
corresponding features; in the images; and 

changed positions for at least some of the selected 3D feature points 
and changed camera projebtions for the images in the subset are calculated by using the 
positions in the images in the subset of the features which correspond to the selected 3D 
feature points to determine change&j>ositions for at least some of the selected 3D feature 
points and changed camera projections^r the images in the subset which reduce the 
calculated error[[;]] a 

wherein the respective subsets of images are selected sequentially 
from the sequence so that each image in the sequence is processed in a subset at least once. 

Claim 34 (currently amended): Apparatus An apparatus for processing input 
data defining (i) the positions of features in a sequence of images of at least one object 
which represent features on the object, (ii) an estimate of a respective camera projection for 
each image defining the projection of points on the object into the image, and (iii) 3D 



feature points comprising estimates of the positions in three-dimensions\^f features on the 
object represented by the features in the images, to generate output data defining further 
estimates of the camera projections, comprising processing means for processing respective 
subsets of the images in the sequence by: 
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calculating an error for the camera projections of the images in the 
subset ^projecting selected 3D feature points into the images in the subset using the 
camera projections of the images in the subset and determining the distance between the 
positions of the projected points and the positions of the corresponding features in the 
images; and 

calendaring changed positions for at least some of the selected 3D 
feature points and changed camera projections for the images in the subset by using the 
positions in the images in the subset of the features which correspond to the selected 3D 
feature points to determine changed portions for at least some of the selected 3D feature 
points and changed camera projections for tjie images in the subset which reduce the 
calculated error[[;]] i 

wherein the processing means is arranged to process respective 
subsets of images from the sequence sequentially su^that each image in the sequence is 
processed in a subset at least once. 

Claim 35 (currently amended): A method of processing data defining 
matching features in images within a sequence of images of at least o^object to determine 
a respective camera projection for each of at least some of the images defining the 
projection of points on the object surface into the image, the method compk^sing: 

a selecting step, of comprising using the matching features to select a 
first image in the sequence and a second image in the sequence for each of a plurality of 
sets of images to give initial end images in the sequence for each set; 
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a set forming step, of comprising , for the selected pair of end images 
for each set, usihg the matching features to calculate a camera projection for one of the 
images in the pair relative to the other image in the pair, to form a set thereform; 

a set expanding step, of com pr ising increasing the number of images 
in at least some of the sets byvusing the matching features to calculate a respective camera 
projection for each of at least son^e of the images lying in the sequence between end images 
of a set and each of at least some of tt^e images lying in the sequence between consecutive 
sets, each camera projection being calculated relative to the images in a set; and 

a set merging step, of comp r ising using the matching features to 
determine the relationship between the camera projections calculated for the different sets, 
thereby to merge the sets. 



Claim 36 (currently amended): A method according to claim 35, wherein, in 
[[the]] said selecting step, an image to form an end image is selected in dependence upon 
the number of matching features in the image which are also present in the preceding end 
image in the sequence. 



Claim 37 (currently amended): A method according to claim 35, wherein, in 
[[the]] said set expanding step, the camera projections for images lying between the end 
images for a given set are calculated before the camera projections for images tying 
between the given set and adjacent sets in the sequence are calculated. 
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\ Claim 38 (currently amended): A method according to claim 35, wherein, in 
the st e p of ^alculating camera projections for images lying between consecutive sets: 

\ (i) the selected end images are prioritised in dependence upon an 
accuracy of the calculated camera projections of the end images; 

\ii) the end image with the highest priority is selected; 
(iii\ the camera projection for the image in the sequence adjacent 
the selected end image is calculated relative to the selected end image to form a new end 
image; \ 

(iv) the prio^ty of the end images is updated in dependence upon 
the accuracy of the camera projection calculated in step (iii); and 

(v) steps (ii) to (iv)\are repeated. 

Claim 39 (currently amended): A method according to claim 35, wherein 
pairs of end images selected in [[the]] said selecting st^p are considered in turn and, for a 
given pair of end images, [[the]] said set forming step to form a set therefrom and [[the]] 
said set expanding step to calculate a respective camera projection for at least one image 
lying in the sequence between the pair of end images and at least one image lying in the 
sequence between an end image of the pair and an end image for aVonsecutive set, are 
performed before performing [[the]] said set forming step and [[thejj said set expanding 
step for the next pair of end images to be considered. \ 

Claim 40 (original): A method according to claim 35, further\comprising 
the step of generating a signal conveying the calculated camera projections. \ 



Claim 41 (original): A method according to claim 40, further comprising 
the step of receding the signal either directly or indirectly. 

Claim 42 (original): A method according to claim 35, wherein the sequence 
of images is a temporal sequence in which the images are arranged in time-of-recording 
order. 

Claim 43 (original): A^method according to claim 35, wherein the images 
comprise video images. 

Claim 44 (original): A method abeording to claim 35, further comprising 
the step of processing image data defining the images in the sequence to generate the data 
defining the matching features. 

Claim 45 (original): A method according to claim 35, further comprising 
the step of using the matching features and the calculated camer^projections to generate 
data defining a 3D computer model of the object in the images. 



Claim 46 (original): A method according to claim 45, further comprising 
the step of generating a signal conveying the 3D computer model. 



Claim 47 (original): A method according to claim 46, further comprising 
the step of recording the signal either directly or indirectly. \ 
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Claim 48 (currently amended): A method of processing data defining 
matchin^sfeatures in images within a sequence of images of at least one object to determine 
a respective chmera projection for each of at least some of the images defining a projection 
of the object into th^ image, the method comprising the steps of : 

fleeting a plurality of groups of the images, each group comprising 
at least two images and at least one pair of consecutive groups in the sequence having 
images in the sequence therebetween which are not part of a group; 

forming a setbf images from each selected group by calculating a 
respective camera projection for each image in the group relative to a reference image in 
the group; 

calculating a respective camera projection for each of at least some 
of the images in the sequence not selected to forma^group relative to a reference image in a 
group; and 

calculating the relationship between \he camera projections 
calculated for each group. 

Claim 49 (currently amended): Apparatus An apparatuk for processing data 
defining matching features in images within a sequence of images of at le^st one object to 
determine a respective camera projection for each of at least some of the ima^s defining 
the projection of points on the object surface into the image, comprising: 

an image selector for using the matching features to select a first 
image in the sequence and a second image in the sequence for each of a plurality of se|s of 
images to give initial end images in the sequence for each set; 
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a set former for using the matching features to calculate, for the 
selected paiKof end images for each set, a camera projection for one of the images in the 
pair relative to thbsOther image in the pair, to form a set thc r cform therefrom : 

a^et expander for increasing the number of images in at least some 
of the sets by using the matchmg features to calculate a respective camera projection for 
each of at least some of the image^ying in the sequence between end images of a set and 
each of at least some of the images lying, in the sequence between consecutive sets, each 
camera projection being calculated relative ro the images in a set; and 

a set merger for using the Snatching features to determine the 
relationship between the camera projections calculated for the different sets, thereby to 
merge the sets. \ 

Claim 50 (currently amended): Apparatus An apparatus according to claim 
49, wherein [[the]] said image selector is arranged to select an imagk to form an end image 
in dependence upon the number of matching features in the image whick are also present in 
the preceding end image in the sequence. \ 

Claim 51 (currently amended): Apparatus An apparatus according\o claim 
49, wherein [[the]] said set expander is arranged to calculate the camera projections jbr 
images lying between the end images for a given set before calculating the camera \ 
projections for images lying between the given set and adjacent sets in the sequence. \ 



-21 - 



Claim 52 (currently amended): A p paratus An apparatus according to claim 
49, wherein [[the]] said set expander is arranged to calculate camera projections for images 
lying betweensxmsecutive sets by: 

\ (i) prioritising the selected end images in dependence upon an 
accuracy of the calculateHxamera projections of the end images; 

(ii) \electing the end image with the highest priority; 

(iii) calculating the camera projection for the image in the 
sequence adjacent the selected end image relative to the selected end image to form a new 
end image; \ 

(iv) updating the privity of the end images in dependence upon 
the accuracy of the camera projection calculated m step (iii); and 

(v) repeating steps (ii) to (iv).\ 

Claim 53 (currently amended): Apparatus Ah apparatus according to claims 
49, wherein the apparatus is arranged to operate so that pairs orend images selected by the 
image selector are considered in turn and, for a given pair of end images, [[the]] said set 
former is arranged to form a set therefrom and [[the]] said set expander is arranged to 
calculate a respective camera projection for at least one image lying in the\sequence 
between the pair of end images and at least one image lying in the sequence between an end 
image of the pair and an end image for a consecutive set, before forming a set and 
expanding the set for the next pair of end images to be considered. \ 
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Claim 54 (currently amended): Apparatus An apparatus according to claim 
49, whehrin the sequence of images is a temporal sequence in which the images are 
arranged in tih^e-of-recording order. 

Claim 5>/currently amended): A p paratus An apparatus according to claim 
49, wherein the images comprise video images. 

Claim 56 (currently amended): Ap p aratus An apparatus according to claim 
49, further comprising a feature matcher ror processing image data defining the images in 
the sequence to generate the data defining th^matching features. 

Claim 57 (currently amended): A p paratus An apparatus according to claim 
49, further comprising a 3D computer model data generator for using the matching features 
and the calculated camera projections to generate data defining a 3D computer model of the 
object in the images. 



Claim 58 (currently amended): Apparatus An apparatu M br processing data 
defining matching features in images within a sequence of images of at least one object to 
determine a respective camera projection for each of at least some of the images defining a 
projection of the object into the image, comprising: 

an image group calculator for selecting a plurality of groupsVf the 
images, each group comprising at least two images and at least one pair of consecuth 
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groups in the sequence having images in the sequence therebetween which are not part of a 
group; 

an image set calculator for forming a set of images from each 
selected group by calculating a respective camera projection for each image in the group 
relative to a reference image iirthe group; 

a camera projection calculator for calculating a respective camera 
projection for each of at least some of t^e images in the sequence not selected to form a 
group relative to a reference image in a group; and 

a camera projection relationship calculator for calculating the 
relationship between the camera projections calculated for each group. 

Claim 59 (original): A storage device storing instructions for causing a 
programmable processing apparatus to become operable to Perform a method as set out in 
at least one of claims 35 to 48. \ 

Claim 60 (original): A signal conveying instructionsVor causing a 
programmable processing apparatus to become operable to perform a method as set out in 
at least one of claims 35 to 48. \ 

Claim 61 (currently amended): In an image processing method ftn" 
processing image data defining a sequence of images of at least one object to generate a 
three-dimensional computer model of the object by matching features in the images, vising 
the matching features to determine camera projections defining the projection of the objfect 
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surface into the images, and using the matching features and the calculated camera 
projectionfcsto generate data defining the three-dimensional computer model of the object, 
an improvement^omprising performing the step of using the matching features to 
determine the camera projections by: 

using the matching features to select a first image in the sequence 
and a second image in the seimence for each of a plurality of sets of images to give initial 
end images in the sequence for each set; 

for the selectecL pair of end images for each set, using the matching 
features to calculate a camera projection ibr one of the images in the pair relative to the 
other image in the pair, to form a set therefomi therefrom ; 

increasing the number ofWages in at least some of the sets by using 
the matching features to calculate a respective camem projection for each of at least some 
of the images lying between pairs of end images in the sequence and each of at least some 
of the images lying between consecutive sets in the sequence, each camera projection being 
calculated relative to the images in a set; and \ 

using the matching features to determine thb relationship between the 
camera projections calculated for the different sets, thereby to merge the sets. 

Claim 62 (original): In an image processing apparatus for processing image 
data defining a sequence of images of at least one object to generate a three-dimensional 
computer model of the object by matching features in the images, using the matching 
features to determine camera projections defining the projection of the object into thV 
images, and using the matching features and the calculated camera projections to generate 
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data dbfming the three-dimensional computer model of the object, a method of performing 
the processing) determine the camera projections by: 

\^ selecting a plurality of groups of the images, each group comprising 
at least two images and atsteast one pair of consecutive groups in the sequence having 
images in the sequence therebetween which are not part of a group; 

forming a seKof images from each selected group by calculating a 
respective camera projection for each image in the group relative to a reference image in 
the group; \ 

calculating a respective cisunera projection for each of at least some 
of the images in the sequence not selected to form kgroup relative to a reference image in a 
group; and \ 

calculating the relationship between^the camera projections 
calculated for each group. \ 

Claim 63 (currently amended): In an image processing apparatus having a 
processor for processing image data defining a sequence of images of at least one object to 
generate a three-dimensional computer model of the object by matching features in the 
images, using the matching features to determine camera projections definingSthe projection 
of the object surface into the images, and using the matching features and the calculated 
camera projections to generate data defining the three-dimensional computer mode\ of the 
object, an improvem e nt wherein the processor is arranged to use the matching features to 
determine the camera projections by: \ 
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using the matching features to select a first image in the sequence 
and a second image in the sequence for each of a plurality of sets of images to give initial 
end images nvthe sequence for each set; 

for the selected pair of end images for each set, using the matching 
features to calculate a camera projection for one of the images in the pair relative to the 
other image in the pair, to forni a set th e r e form therefrom ; 

increasing'the number of images in at least some of the sets by using 
the matching features to calculate a respective camera projection for each of at least some 
of the images lying between pairs of end in^ages in the sequence and each of at least some 
of the images lying between consecutive sets ir^the sequence, each camera projection being 
calculated relative to the images in a set; and 

using the matching features to determine the relationship between the 
camera projections calculated for the different sets, therebVto merge the sets. 



Claim 64 (currently amended): Apparatus An apparatus for processing data 
defining matching features in images within a sequence of images orat least one object to 
determine a respective camera projection for each of at least some of the\mages defining 
the projection of points on the object surface into the image, comprising: 

selecting means for using the matching features to select ^first 
image in the sequence and a second image in the sequence for each of a plurality offsets of 
images to give initial end images in the sequence for each set; 
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set forming means for using the matching features to calculate, for 
the selected pair of end images for each set, a camera projection for one of the images in the 
pair relative to the other im^ge in the pair, to form a set thc r cform therefrom ; 

set expanding means for increasing the number of images in at least 
some of the sets by using the matching features to calculate a respective camera projection 
for each of at least some of the images IVing in the sequence between end images of a set 
and each of at least some of the images lying in the sequence between consecutive sets, 
each camera projection being calculated relative to the images in a set; and 

set merging means for usingvthe matching features to determine the 
relationship between the camera projections calculateo^for the different sets, thereby to 
merge the sets. 



Claim 65 (currently amended): Apparatus An apparatus for processing data 
defining matching features in images within a sequence of images of at least one object to 
determine a respective camera projection for each of at least some of tn^ images defining a 
projection of the object into the image, comprising: 

means for selecting a plurality of groups of the images^ach group 
comprising at least two images and at least one pair of consecutive groups in the\^equence 
having images in the sequence therebetween which are not part of a group; 

means for forming a set of images from each selected group b> 
calculating a respective camera projection for each image in the group relative to a 
reference image in the group; 
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means for calculating a respective camera projection for each of at 
least soihe of the images in the sequence not selected to form a group relative to a reference 
image in a gK^up; and 

means for calculating the relationship between the camera 
projections calculatecNpr each group. 



Claim 66 (newj\A method of processing data defining (i) the positions of 
features in a sequence of images orat least one object which represent features on the 
object, (ii) an estimate of a respective c^nera projection for each image defining the 
projection of points on the object into the image, and (iii) 3D feature points comprising 
estimates of the positions in three-dimensions of features on the object represented by the 
features in the images, to generate output data defining further estimates of the camera 
projections, the method comprising processing respective subsets of the images in the 
sequence by: 

calculating an error for the camera projections of the images in the 
subset by projecting 3D feature points into the images in the subset using the camera 
projections of the images in the subset and determining the distance tetween the positions 
of the projected points and the positions of the corresponding features ifiythe images; and 

calculating changed 3D positions for at least some oMhe 3D feature 
points that were projected and changed camera projections for at least some oftthe images 
in the subset by using the positions in the images in the subset of the features whteh 
correspond to the 3D feature points that were projected to determine changed 3D positions 
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prbj^ctions for at least some of the images in the subset which reduce the calculated 
error[[;]]^\ 

wherein the respective subsets of images are selected sequentially 
from the sequence scrthat each image in the sequence is processed in a subset at least once. 

Claim 67 (new): s An apparatus for processing data defining (i) the positions 
of features in a sequence of images of\at least one object which represent features on the 
object, (ii) an estimate of a respective camera projection for each image defining the 
projection of points on the object into the image, and (iii) 3D feature points comprising 
estimates of the positions in three-dimensions of features on the object represented by the 
features in the images, to generate output data definingvfiirther estimates of the camera 
projections, comprising a processor operable to process respective subsets of the images in 
the sequence by: \ 

calculating an error for the camera projections of the images in the 
subset by projecting 3D feature points into the images in the subset ufcing the camera 
projections of the images in the subset and determining the distance between the positions 
of the projected points and the positions of the corresponding features in thkimages; and 

calculating changed 3D positions for at least some of the^D feature 
points that were projected and changed camera projections for at least some of theumages 
in the subset by using the positions in the images in the subset of the features which \ 
correspond to the 3D feature points that were projected to determine changed 3D positions 
for at least some of the 3D feature points that were projected and changed camera \ 
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projections for at least some of the images in the subset which reduce the calculated 
error[[;]] a 

wherein the processor is arranged to process respective subsets of 
images from the sequence sequentially such that each image in the sequence is processed in 
a subset at least once. 

Claim 68 (n^w): An apparatus for processing data defining (i) the positions 
of features in a sequence of images of at least one object which represent features on the 
object, (ii) an estimate of a respectivte^camera projection for each image defining the 
projection of points on the object into th^shnage, and (iii) 3D feature points comprising 
estimates of the positions in three-dimensions^of features on the object represented by the 
features in the images, to generate output data denning further estimates of the camera 
projections, comprising processing means for processing respective subsets of the images in 
the sequence by: \ 

calculating an error for the camera projections of the images in the 
subset by projecting 3D feature points into the images in the subset using the camera 
projections of the images in the subset and determining the distance between the positions 
of the projected points and the positions of the corresponding features imthe images; and 

calculating changed 3D positions for at least some ortfie 3D feature 
points that were projected and changed camera projections for at least some of the images 
in the subset by using the positions in the images in the subset of the features which 
correspond to the 3D feature points that were projected to determine changed 3D positions 
for at least some of the 3D feature points that were projected and changed camera \ 
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projections for atsteast some of the images in the subset which reduce the calculated 

em>r[[;]L \^ 

whereinHiie processing means is arranged to process respective 

subsets of images from the sequence sbquentially such that each image in the sequence is 

processed in a subset at least once. X. 

Claim 69 (new): A storage device storin^c^miter program instructions for 
programming a programmable processing apparatus to become opbrable to perform a 
method as set out in claim 66. \. 

Claim 70 (new): A signal conveying computer program instructiohs for 
programming a programmable processing apparatus to become operable to perform a\ 
method as set out in claim 66. \ 
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